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Abstract: Cloud computing has become a new computing paradigm as it can prq^de^^alable IT 
infrastructure, QoS-assured services and customizable computing environment. AlthoA^^heie are many 
research activities or business solutions for Cloud computing, most of them are focuse<foiWngle-provider 
Cloud. As a key service delivery platform in the field of service computing. Cloufcjjyfttputing provides 
environments to enable resource sharing in terms of scalable infrastructures, n^fM^mre and application 
development platforms, and value-added business applications .This study exami^/Tthe latest technology 
in the field Cloud Computing. The main study focused on load balancinglfc^irttel machines inside single 
cloud data center. There different algorithms for balancing, one of tterl^l^lied Throttled load balancing 
which treats the virtual machines based on two values that can sei^^^re intended virtual machine or 
send it to the remote ones .A proposed modification has been pronogsd/re solve some of the key features in 
this algorithm like Process migration, Fault tolerant and Overloa<fireiection. The idea is to send even when 
all the virtual machines heavily loaded by determining the m^t i^Spectable hardware specifications of the 
virtual machines. 




Keywords: Cloud Computing, cloud Virtualization, WgffA*ancing, Cloud Data Center 

Irihiqpuction 

Cloud computing refers to both the appli^niftns delivered as services over the Internet and the hardware 
and systems software in the data centej^aa^ provide those services. With a connection over the internet, a 
consumer is able to access variou jr^ft)\jifi#s, be it premium or free in order to perform certain functionality 
and all these constitute a cloud; lH^^vices themselves have long been referred to as Software as a Service 
(SaaS). Some vendors use terra^uclras IaaS (Infrastructure as a Service) and PaaS (Platform as a Service) to 
describe their products. Thismsy say with cloud computing, a cloud is formed over the amalgamation of 
various services be it pbysfonf)r virtual over a network to perform certain services (Parhizkar B. et.al, 2013). 




<3 



By deploying IT infi»rau^ure and services over the network, an organization can purchase these resources 
on an as needej^^^and avoid the capital costs of software and hardware. With cloud computing, IT 
capacity cai^^aahisted quickly and easily to accommodate changes in demand. While remotely hosted, 
managed sf^^S^iave long been a part of the IT landscape, a heightened interest in cloud computing is 
being fuAd^ ubiquitous networks, maturing standards, the rise of hardware and software virtualization, 
and thK™sn to make IT costs variable and transparent. 

Iweawinterest in cloud computing has been manifested from both academia and private research centers 
wanumerous projects from industry and academia have been proposed. In commercial contexts among 
e others, we highlight: amazon elastic compute cloud, IBM's blue cloud, etc .There are several scientific 
activities driving toward open cloud- computing middleware and infrastructures such as reservoir and 
eucalyptus, etc (Parhizkar B. et.al, 2013). 



Clouds aim to power the next generation data centers as the enabling platform for dynamic and flexible 
application provisioning. This is facilitated by exposing data center's capabilities as a network of virtual 
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services (e.g. Hardware, database, user-interface, and application logic) so that users are able to access and 
deploy applications from anywhere in the Internet driven by the demand and QoS (Quality of Service) 
requirements. Similarly, IT companies with innovative ideas for new application services are no longer 
required to make large capital outlays in the hardware and software infrastructures. By using clouds as the 
application hosting platform, IT companies are freed from the trivial task of setting up basic hardware and 
software infrastructures. Thus they can focus more on innovation and creation of business values for their 
application services. 

Related works 

According to Abhay Bhadani and Sanjay Chaudhary (Bhadani A. et.al, 2010), they propose a 
Balancing Policy for Virtual Machines (CLBVM) to balance the load evenly in a dktriflljteJr^virtual 
machine/cloud computing environment. This effort tries to compare the performance o^Xbs^ers based 
on their CLBVM policy and independent virtual machine(VM) running on a single plf^lCcfr server using 
Xen Virtualizaion. The paper discusses the value and feasibility of using this ldryfrcypplicy for overall 
performance improvement. 

The proposed CLBVM policy is at an inception stage and requires vwri*^px+vO as well as memory 
availability on the target server. The CLBVM policy has the potentiaLfeJ^pjbve the performance of the 
overall N Servers though it does not consider fault tolerant systA^yB»ey tried to make the system 
completely distributed such that, if the performance of the VM getmanN^ied by another VM, it can move 
itself to lightly loaded server on the go (Bhadani A. et.al, 2010). 

Glauco Estacio Gon^alves et. al (Gon^alves, G. E. et.al ^»^)f proposed algorithms for allocation of 
computing and network resources in a Distributed clou^^(?loud) with the objectives of balancing the 
load in the virtualized infrastructure and of consid^rite^pnstraints, such as processing power, memory, 
storage, and network delay. The evaluation of theVipkithm shows that it is indeed adequate for link 
allocation across different physical networks. It a^™cbrs that links are unconstrained in terms of capacity. 
They argue that this situation is well-suitetj^o apay-as-you-go business plan, very common in Cloud 
Computing and it allows a better usage oftfhti%ources than the common idea of link capacity reservation. 
The proposed algorithms were tested tia^^rr simulations, focusing on the improvements brought by the 
minimax path strategy. The experimfrt^snowed that the minimax path strategy can offer better load 
balancing, in terms of maximurMu^ksfress than heuristics from the literature as the rate of requests 
increases (Gon^alves, G. E. et.^2013^ 

Zehua Zhang and Xuejie ZlM^Zhang Z. et.al , 2010), proposed a load balancing mechanism based on ant 
colony and complex n^v^j/theory in open cloud computing federation in this paper, it improves many 
aspects of the relate\Ay Colony algorithms which proposed to realize load balancing in distributed 
system, Furtherm^^HJnis mechanism take the characteristic of Complex Network into consideration. 
Finally, the neij/G^pmce of this mechanism is qualitatively analyzed, and a prototype is developed to enable 
the quantitaflAaiKilysis, simulation results manifest the analysis. 

I^I^oti improves many aspects of the related Ant Colony algorithms which proposed to realize 
^cing in distributed system, and the characteristic (small-world and scale-free) of Complex 
r have been taken into consideration (Zhang Z. et.al , 2010). 




rinivas Sethi et. al (Sethi S. et.al , 2012) , they introduced the novel load balancing algorithm using fuzzy 
logic in cloud computing, in which load balancing is a core and challenging issue in Cloud Computing. The 
processor speed and assigned load of Virtual Machine (VM) are used to balance the load in cloud 
computing through fuzzy logic. It is based on Round Robin (RR) load balancing technique to obtain 
measurable improvements in resource utilization and availability of cloud- computing environment. 
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The network structure or topology also required to take into consideration, when creating the logical rules 
for the load balancer. Two parameters named as the processor speed and assigned load of Virtual Machine 
(VM) of the system are jointly used to evaluate the balanced load on data centers of cloud computing 
environment through fuzzy logic (Sethi S. et.al, 2012). 

Pengfei Sun et. al, They presented a new security load balancing architecture-Load Balancing based on 
Multilateral Security (LBMS) which can migrate tenants' VMs automatically to the ideal security physjcal^^k 
machine when reach peak-load by index and negotiation. They have implemented their prototype based 
CloudSim, a Cloud computing simulation. Their architecture makes an effort to avoid potential atjacl^ 
when VMs migrate to physical machine due to load balancing (Sun P. et.al, 2011). 



Shu-Ching Wang et.al (Wang S. et.al, 2010), they introduced a two-phase scheduling akorft£^^ader a 
three-level cloud computing network is advanced. The proposed scheduling algoritl^nXcorgmnes OLB 
(Opportunistic Load Balancing) and LBMM (Load Balance Min-Min) scheduling algoritjfffl^Wat can utilize 
more better executing efficiency and maintain the load balancing of system. 



The goal of this study is to reach load balancing by OLB scheduling algorithm, w1m» makes every node in 
working state. Besides, in their research, the LBMM scheduling algoritfinWs £So utilized to make the 
minimum execution time on the node of each task and the minimunywgp^ ^mpletion time is obtained. 
However, the load balancing of three-level cloud computing networkOljm^ed, all calculating result could 
be integrated first by the second level node before sending back t^n^Vianagement. Thus, the goal of 
loading balance and better resources manipulation could be achie^W^rang S. et.al, 2010). 

He-Sheng WU et.al (Wu H. et.al, 2013), discussed the new ckj^cr^ristics the load balancing should have in 
cloud computing. In cloud computing, load balancing A^p^s virtual machine in the cloud instead of 
actual one. Therefore, load balancing system should b^ravided with the function of elastic management 
of back-end resource, i.e. to dynamically add or dffl™^back-end server (existing in the form of virtual 
machine in the cloud) based on actual network l<^Miiidition. 

Since the virtual machine for load balanciaflTml^agement in cloud computing can be dynamically applied 
and released, an algorithm of predictian^asgd elastic load balancing resource management (TeraScaler 
ELB) is presented to overcome the drawbacks. 

Experiments have shown that the%|qiiired number of virtual machines change in compliance with the 
change of network load, thu^/ftl|aScaler ELB is able to dynamically adjust the processing capacity of back- 
end server cluster with th^Adifed load. Besides it could make full use of the 'use on demand' feature of 
cloud computing, Ter^^lj^^LB leads to a better application of prediction based load balancing in cloud 
computing. It conckfie^ithat compared with the traditional elastic resource management algorithm, 
TeraScaler ELB is ^J^i^asonable for providing scalability and high availability (Wu H. et.al, 2013). 

Jiann-Liang\lmnyet. al (Chen J. et.al , 2012), this paper presents a study to improve cloud computing 
systems ^rr^™ance based on Eucalyptus cloud platform. An optimal load balancing mechanism called 
EuQoSVs^m for scheduling VMs is proposed. Extending EuQoS to accommodate real-time services, 
Had^^Nlatform is integrated into the EuQoS system. Log processing services are utilized to investigate 
tM^terrormance of system throughput. Experimental results indicate that the proposed EuQoS system can 
ye system throughput by 6.94% compared with the basic Eucalyptus platform with Hadoop 
'echanisms. 



According to Xiaona Ren et. al (Ren X. et. al , 2011), Considering the unique features of long-connectivity 
applications, an algorithm is proposed, Exponential Smoothing forecast-Based on Weighted Least- 
Connection ESBWLC. ESBWLC optimizes the number of connections and static weights to actual load and 
service capability, and adds single exponential smoothing forecasting mechanism. Finally, experiments 
show that ESBWLC can improve the load of real servers effectively. 
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Analysis of Previous Load Balancing Algorithms 



The throttled algorithm has been chosen to be modified based on the simulation conducted as it has better 
results compared with the other algorithms especially if it is working with response time algorithm and 
based on recommendations of the experts that we have found in the articles (Shiraz M. et. al , 2012). 
Throttled algorithm is also known as the threshold algorithm as it has two values (tUpper and tUnder) 
which specify the load on the virtual machines. If the load is greater than the value of tUpper then, it ^iU^^^ 
send the process to the remote processor, otherwise if the load if less than the value of tUnder then it w\^^ 
process it locally and if the virtual machine is overloaded then it will update the other virtual machij*es 
its state. The algorithm has a low inter-process communication as most of the load is processedjt^yllv 
which leads in performance as there is not much sending and receiving of jobs (Sanei Z. et. al, ^%^t 

There many metrics that govern the load balancing in a virtualized data centers, the tJ|»hol4 algorithm 
guarantees most of them except some which are as follows (Sharma S. et.al, 2008): 



Overload Rejection: If Load Balancing is not promising additional overloaj 
needed. When the overload situation ends then first the overload rejection me. 
short guard period Load Balancing is also closed down. 





ion measures are 
are stopped. After a 



faults or not. It enables an 
the performance of algorithm 
en a small failure can cause total 



Fault Tolerant: This parameter gives that algorithm is able to be, 
algorithm to continue operating properly in the event of some fail 
decreases, the decrease is relational to the seriousness of the ft 
failure in load balancing. . 

Process Migration: Process migration parameter pro^S^when does a system decide to migrate a 
process? It decides whether to create it locally or create%»qn a remote processing element. The algorithm is 
capable to decide that it should make changes of loafilrsiribution during execution of process or not. 



Proposed Frew Algorithm 




As a result we can conclude that whea^J^vTrtual machines is heavily loaded and also the other virtual 
machines overloaded then it will not^dLdJny incoming jobs to the remote processor as it is overloaded and 
it will process it locally, our ideax^hen a virtual machines is overloaded, the algorithm can still send to 
the most respectable virtual ^mch\e in terms of physical hardware specifications, this will lighten the 
burden of one virtual machii^r^the other as it will make the strongest virtual machines handle the load 
while the others processingSmrthe others will finish the jobs and back to the original state. This will help 
solving some the meXpf&yJh. should be found in the load balancing algorithms like overload rejection 
(Abhijit A. et.al, 20L2^vr]m modification will make a queue of new incoming jobs for the strongest virtual 
spectw^f^as the load on one overloaded processor can be much higher than on other 
causing significant disturbance in load balancing, and increasing the execution time 



machines respect 
overloaded 
of an applied 



jm&^^m, ca 



Table 1: Analysis of Throttled algorithm (Abhijit A. et.al, 2012) 



Parameters 


Threshold Algorithm 


Nature 


Static 


Overload Rejection 


Yes 


Reliability 


Less 


Adaptability 


Less 


Stability 


Large 


Predictability 


More 


Forecasting Agency 


More 
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Cooperative 


Yes 


Fault Tolerant 


Yes 


Resource Utilization 


Less 


Process Migration 


Yes 


Preemptiveness 


Non-preemptive 


Response Time 


Less 


Waiting Time 


More 


Turnaround Time 


Less 


Execution System 


Decentralized 


Throughput 


Low 


Processor Thrashing 


No 



Simulation and Results 

In this section, this paper will try to show some the simulations conducted 
algorithm as the algorithm to modify. First simulation was conducted to test thjf^de 5 

ente^D i 



Loose tht 



the throttled 
Algorithm with the 

closest data center as the service broker whereby it chooses the closest data cente^rFthe user request. The 
second simulation was conducted for the throttled algorithm but in rega^r1^o^he*best response time of the 
data centers the request was made to. In the third round the simulatiort^^^^ed for throttled in regard to 
reconfiguring dynamically of the data center located around the J^^^vhereby the requests can be 
directed flexibly according to the best data center that can serve th£j\flu]ret. 



Throttled With Closest 



inter 



The first round was tested using the Throttled algorithiOS^ the load balancing strategy with the Closet 
Data Center as the Data Center broker policy. The simutepi|pns were conducted for 100 virtual machine and 
a total of iooo requests per user per hour, with an aj/\ag^of ioooo users in a peak hours and 100 in off-peak 
hours with 6 user bases located in different loca*j^K%round the world and 6 Data Centers also located in 
different locations around the world as showjpin figure 1. 



Configure Simulation 
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Figure i: User base specification and service broker policy for the data center 
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In figure (2, 3), explanation on how to do the configuration for the simulation that is going to be tested on, 
Whereby the selection of the user requests that can be made per hour and whether it's a peak hour or 
normal hours to simulate a real world events as well as the starting and ending times for these requests. The 
data center broker that will govern the behavior of the data center have been identified as well ,for example 
in this simulation ,the closest data center which means the closest one for the requests to be entertained 
around the world. Hardware specifications of the data centers like the memory , CPU speed , the number of 
cores inside each CPU ,the operating system, the number of virtual machines inside each data centers ^ n d^^W 
the cost that for each virtual machine to use the memory and CPU cores have been defined as well . 



Configure Simulation 
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Figure 3: User requests and the load balancing algorithm 
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In figure 4, it shows the geographical location or each data center with their average, minimum and 
maximum execution time that can be taW1^nV:onsideration when simulating with respect to each user 
request and whether this request is madn^^ri single user or multiple. 

The results for the simulation candpltgJ based on the specification provided in the above figures that 
shows the overall response timelfc^^ie data centers and the cost for the virtual machines to serve the 
requests if the broker is set tb^pse striata center. 



Results 



^ Avg (ms) 


Min 


(ms) 


Max (ms) 


Overall response time 


H135 


54.87 


225.52 


Data Center processing time 


91.72 


12.65 


167.76 



Cost 



Total Virtual Machine Cost ($) 


Total Data Transfer Cost ($) 


Grand Total ($) 


60.00 


5.76 


65.76 



Throttled with Optimize Response Time 



The second round was tested using the Throttled algorithm for the load balancing strategy with the Closet 
Data Center as the Data Center broker policy. I have conducted a simulation for 100 virtual machine and a 
total of 1000 requests per user per hour, with an average of 10000 users in a peak hours and 100 in off-peak 
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hours with 6 user bases located in different locations around the world and 6 Data Centers also located in 
different locations around the world as shown in figure 5, 



Configure Simulation 
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Figure 5: User base specification and service brok^^^icy for the data 

uration^agtl 
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In figure (6, 7), explanation on how to do the configuration^aroh# simulation that is going to be tested on, 
Whereby the selection of the user requests that can betfh^e per hour and whether it's a peak hour or 
normal hours to simulate a real world events as well asfc^tarting and ending times for these requests. The 
data center broker that will govern the behavior ofVm^Ska center have been identified as well ,for example 
in this simulation , optimize response time whicl^g?S*s the best data center that responded to the request 
to be process around the world based on th^Jjardware specifications of the data centers like the memory , 

i\J ,the operating system, the number of virtual machines 
*ach virtual machine to use the memory and CPU cores have 
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Figure 6: Data Center specifications 
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Configure Simulation 
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Figure 7: User requests and trr^fod oalancing algorithm 
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Figure 8: Data center locations and user bases requests 
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In figure 8, it shows the geographical location of each data center with their average, minimum and 
maximum execution time that can be taken in consideration when simulating with respect to each user 
request and whether this request is made from single user or multiple. 



The results for the simulation conducted based on the specification provided for the data centers and the 
virtual machines shows a better results if the broker set to optimize response time in terms of data center 
execution time and cost of the virtual machines. 



Results 



Avg (ms) 


Min (ms) 


Max (ms) 


Overall response time 


89.14 


43.86 
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Data Center processing time 
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331 
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Cost 



Total Virtual Machine Cost ($) 


Total Data Transfer Cost ($) 1 Gr&£J*otal ($) 


50.50 


5.76 ^56.26 



Throttled with Reconfigure Dyna 



The third round was tested using the Throttled algorithm for t 
Data Center as the Data Center broker policy. I have conducted 
total of 1000 requests per user per hour, with an average of 
hours with 6 user bases located in different locations ari 
different locations around the world as shown in figure 
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Figure 9: User base specification and service broker policy for the data center 



ICCCEG 2014 



ISBN : 978-81-929742-2-4 



www.edlib.asdf.res.in / www.iccceg.org 



Proceedings of the Intl. Conf. on Cloud Computing and eGovernance 2014 [ICCCEG 2014] 



83 



In figure (10, n), explanation on how to do the configuration for the simulation that is going to be tested on, 
Whereby the selection of the user requests that can be made per hour and whether it's a peak hour or 
normal hours to simulate a real world events as well as the starting and ending times for these requests. The 
data center broker that will govern the behavior of the data center have been identified as well ,for example 
in this simulation , reconfiguration dynamically which means the data centers can serve the requests 
respectively but if there are other data centers available which are better than the current one, it will switch 
automatically to the best one accordingly. Hardware specifications of the data centers like the memojy^V 
CPU speed , the number of cores inside each CPU ,the operating system, the number of virtual machirl^^W 
inside each data centers and the cost that for each virtual machine to use the memory and CPU core^jiavj^ 
been well-defined as well . ^ 
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Figure n: User requests and the load balancing algorithm 
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Simulation Complete 




Figure 12: Data center locations and user h 

In figure 12, it shows the earthly location of each data center with fib™ 
execution time that can be taken in consideration when simulattin^^t 
whether this request is made from single user or multiple. ^ 
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Min 


(ms) 


Max (ms) 


Over«t^|ponse time 


139.98 


44.29 


227.18 


Dataj^nter^processing time 


90.35 


3.90 


169.44 



Cost 



Tota^^Jn Machine Cost ($) 


Total Data Transfer Cost ($) 


Grand Total ($) 


J7> 5347 


5.76 


59.50 



Conclusion 

ting is a new edge technology that is versatile, fast and developing at a fast rate. In this report, 
models of implementation of cloud computing has been studied. It is obvious that the cloud 
f fcicjpt is a way to-go method of technology implementation these days. The trend of development is high, 
ough much has been accomplished there is still a lot to do in this field of cloud computing for the future 
neration. One of the biggest buzz terms in technology today is cloud computing? Companies all over the 
world are utilizing the cloud for their businesses, allowing users to access their technology anytime, 
anywhere. Essentially, organizations who are using the cloud, or cloud computing, have their files, software, 
information and resources available anywhere in a virtual network. A modification for throttled algorithm 
has been identified to increase the efficiency of its response time and data center processing execution time 
and cost. Implementation of this modification in the CloudSim and Cloud Analyst will conducted as a 
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future work. Cloud analyst has been chosen to simulate the current throttled algorithm in respect with 
different service broker. The results show that throttled algorithm is the chosen algorithm to modify as it 
has better results in terms of overall response time and data center processing. 
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